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sTyvi usoi' c:i.AiiviS 

Claims 1-26 arc pending. 
Claim 26 is willulniwn iVoni considcralion. 

Claims I -25 sUuid rcjcclcd under ."^5 IJ.S.C:. § I03(ii) as hcunj, iinpalcnlahlc owi 
'roynay./.ini ct al. (US Palcnl No. 5.XH6,683) in view ufJoncs ((il^ 2J 71V)I()). 

OVl'lKVIhiW ()|- ClAIMI-:i)lNVivN ri()N 
'I'hc prcscni invention provides for a sysicm and niclhinl for reeo>;ni/ini». Irom eyi: 
paltcms, when the user is reading, skimming, or scanning on a ilisplay filled with lu leini^ neous 
e^)nieni. Heterogeneous eonicnl ineludes objects iu>rmally encouniered »»n eonipuU i mumiors, 
such as text, images, hyperlinks, wimlows, icons, and menus, in one emhoilunenl, du- sysleni 
uses inlbrmalion about what text die user is reading or skinnning lo iider user inU-ji'st :inil usi n 
this inforniation to adapt to (he user's neetls. The atlaplalit>n priH:ess inchides reeoutine; Ihi* lexi Q 
of interest in a user moilel and using ihe lexl (o (Ind related inlormalit>n i'uHw K»eiil maehuu- 
dutahases, local area network databases, or wide area network diitabases siurh as iIk- World VVule ^ 
Web. 



The present invenlioirs nielhoil lor recognizing, from eye-ga/.e pallerns, when a nsei js 
reading, skimming, or scanning, e4>mpri.^cs at leasi the steps o\': (I) en;ir.se t>t i|ii;iiili/vil 
represenialion of cyc-movemenls of a user viewing heterogeneous eonleni (ey, te.\i, im.ii^.es, 
hyperlinks, windows., icons, menus, etc.), (2) pooled evidence based tleieeli*)n. mh\ (.^) mode 
switeliing. I'irst, die eye-movements in both x and y positions are t|uanli/ed (ami aveiav.ed) (e.>v. 
over 100 ms intervals). This process removes some of the imuxuraey ofpiiui evi* n;K km.!'. 
hardware and reduces the iniluenee of micro-saeeades. See<*iul. evidence *»r reatiin- 

I'ayy J it/ / / 
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accumulated until it crosses a lliivshoUl value, l lic system miiy iiicivmenl :t iv.uliiir. ovidcnci- 
variable by 1, for inslaiice, wIil-h ilic eye moves to the riglu aiul dc-iturinnLiiiiiit' hy I. !«'• 
inslaiicc, when the eye moves lo the lel\. II" the rc-atliiiiji'YKiyilil'i^ Hm shoUl. ilicn 

■'reading" is delected and Ihe m(»do switched from scamiing t«> reading. II' Hio ihashoM is n.>l 
reaelieil, then the syslom continues tn collect evidence orreadint*. 



'l"he U.S. palem lo 'royna/./.ini cl id. (hereon ToKna/./ini), on ihe oilier hand, disrl.^scs ;ui 
effort lo capitalize on cyc-ya/e as xi mca.surc of user iiitcrcs(. Togna/./iiii dcsi i iliLS a iiu.di<id aiul 
apparatus for providing rclovanl inlbnnatii^n based on eyc-ga/c. l or example, micrcsl ui soiur 
display object (icon, iniaye, or block of Lc.Kl) is (leteniiinal based tm a llxalion Mui sliokl. Il iliv ^ 
user looks at an objcjjl on the screen long enouiili. the system infers ilial Ihe u.sci is uilcieslcil in 
thai object. This same rule al.so iipplies lo hlocks ol (ext. ^ 

o 

The Foreign patent ((.ill 2170010) io Jones (hereon Jones) proviilus foi ;in L-ye ti;u kinj', 
sysicni wilh a coiUrol signal lhal is responsive lo ilie Mireclion of li>ok* ol u person^s i-ye. hyi- 
movenienl is tieiceled hy consUinlly measuring Ihe laic ofehangc orpolcniial <iilHMvneL- hrUvixu 
ihc electrodes and comparing il against a threshold rale 1)1*2*' per seeiMttl. It sliouUI he Jiou-*! lhal 
the threshold value doscribed in Jones describes a "threshojd villus^ !'^.>i' <^y<' inovennMu;' (i>ar.e 1, 
hne 6:^) and nol a ih reshold_value cd'roadiiig(as provided lor in the pieseni inveniion). 

It should be pointed out lhal there is no disclosure, either explicitly or implicitly, priwiilrtl 
for in Togna/y.ini an<!/or Jones (o: 

L deicrmine dilTerent levels of user interest based on the type of user bch;ivitn, such as 
i-eadint> (hiuh inlerest), skimiimiii (medium), scanning {low inlciesl). 
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2. switch moties 1*10111 cillicr a skimming or scaiiniiu*. nuuk-. lo a rcailiii)*. iiuulc wIkm 
rc adinu is dcioclctl, or 

3, captur e th e exac t words thai are read by a user, wherein ihe caimiu d words arc 
utih/.etl lo: 

a. (Inil relevaiil iiilorinalioii in a ilatabaso over a network (sueh as die Inlernel): 

develop accurate iiioilels of users; 
e. determine line grained inlbrmalion rei»arding Inlernei ailveriisinL;; *>! 
d. provide eonle>;< basetl help in eonlpuler appliealions. 

In t he ( -laim s 

iiiij !-:( ^ noNS. uNDiiR U-S.ci^. ! o-HiO 

The Hxaniiner has rejeclctl claims 1 25 under U.S.(" § 103(a) as bein^' uiipalenlabie ovn 
'l ogna//ini in view of Jones. Willi respeel (o these claims (claims I -.15), applicants uvspi ellully 
disagree with the lixaminer as diey contend dial the prestmlly elaimeil invaiUon cannt>l iu- 
obvious in view of any ol" Ihe relerenoes because, even il lliere were a sui^l>^slit»n li> t onibniv O 
them, a combination ofUiese references would not result in die presently claime<l mvenlii)n 

With respeel 10 claim 1, ihc lixaminer states (hat the l oiJ^na/./iin disch>ses a ini:ilu>d ol 
(1) reeugni/.ing reading, skinuning, and scanning modes from eye ga/e paUeius (m col. -1. Inus 
50-54 and col. 17, lines 1-5) and (2) quanli/.ing eye niovcmenls. A close reading, ol l ogna/znu 
references, Iiowcver, indicates tliat lite disclosed method determines wlielher die usi r skinnnol 
\hc information or read the inCormation by *^meas uriou Ih e amoiul! (>.f lime spirni with eai h arliclc 
and adverlisemeor' (see column 17, lines 1-5 of Ihe lognaz/ini relcrence) Thns, l'ogna//ini 
detects regions of interest (nol actual reading) by tlelennininK ihc time speni i.',a/inv. :'i •» 
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particular region of Ihe computer screen. By slark contrast, rcjulinK is dcieckd b.iscil u[uui 
"^icc umulalinu a numer ical eviilence o\' r eiuliim unlil a prcJeimijitied llireshoUl is reacliol" (sec 
claim I of the claimed inveiilion). Applicants contend that the preseni invenlinn^ readmit 
detection is dilTcront and nnich more bophis|icale<.i than rogna/./ini's method in ilur liu l (hat de- 
claimed invcnlion^s method ofdetecling reading is based npon collccling a unmerieal i-vulciu e 
and threshold. 



One specific example of the claimed invention (iis outlined in page *), line in m pa.ue 10. 
line 1 of die application as llled) proviiles lor a readini^-evidence variahle llial can he ^ 
incremental by I when Ihe eye nuwes to the right and decremented by -1 when die eyi- oiow s 
towards the IcH. The rcadin^'^ evidence is then compared against a predelerniined thu:shol<l (sjy 

beCorc reading is detecled. Tins is in stark contrast with the melh*Hl or iWjur/./.ini wlu're.in ;i q" 



region of interest is detecleil (nol actual reading) based upon the amiiunt ol linie speni r,n/.mi| ;n 
that particular region in a computer screen. 

Applicants agree wilh the lvxamincr*s statement that rogna/./ini fails U> nu jiiion du- 
limitation of ^•aceumtdaling a nmnerical evidence of reading until a prede(ernnne<l lhreslit>M is 
reached; and delecling reading when the numerical evidence of leailing exceeds Ihe IhieshoUi;' 
Applicants, however, strongly ilisngree that the Jones reference proviiles for ihesi' leahnvs A 
close reading of the Jones reference clearly suggests that sign;d rale of eluinge is i i>iiipared 
auains t a dircsho ld value of e ye move ment measured in <legrees/sec (see page 2, lines 4S and 
lines (^{-(^5 of the Jones reference) and nol auainst a nnn^e riciil duesjiold value of readini* (its 
require d bv claim I). 



CO 

I 
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Applicants ihus coiiioiul iluu ilic c«imhiiuition »)r iugnir/./iiii ;iinl .loiics «l«)cs ii.x make llu: 
claimal invcmion obvious, flic ahovc-monlioiicti aiuunicnls o«|iially ;ipply li» iixLpLii.lLiit 
cluims 12. 23, 24, and 25. 'I'luis, applicanls respect lully iisk liw oxMiiiiiici U> Ronisukr 
imlcpcildeiil claims 1.12, 2^, 24. and 25 in oflhc above iiic.ilioiieil ariiimicDis. 

Kegardiiiij dependent elaint 2, applicants contend thai Toi'iia/./ini d-.as .u.i Itai h, cilhei 
by iLSolf or in combinalion with Jones, u method for M»:«ilii''"y movemenls tl.r dclo lii.e 
i-cading via a ihresliold. As to ilependent claint X applicants conlend Ihat los^na/./ini lail.s to 
provide I'or a method tor deioclini^ reading (via a threshold) when a user is reading., sidnnuliii;. oi 
scanninj; heterogenctuis content. Kewarding dependent clainus 4 5 ■| oi'na//.mi Tails to providi- lor 
a threshold-based reading detection method that includes a step lor switihinj; bchv.xii a ^ 
scanning/skimmitig mode to a reading n«"di> (when reading is delected upon reat hin.u tin- Q 
threshold). Additionally, as mentioned above, tlie Jones reference clearly siiji..;y.s|s llul sij-ual Q_ 
rate of ciiangc is conipaicd aKaiiLsl a threshold value of eye movement and not avainsi a Q 

O 



nuntei ical threshold valne of reading. 

With regard to dependent claims 6 and 10-11, applicants etnitend thai layitu/./uw 
proviiles for a method for monitoring eye ga/c patterns to deleioiine a level o( inleii-si. l iiiis, die 
method of logna/./.ini measures the lime period and location (within the screi:M) ol an eye. v;a/.e 
Thus, if a user stares at a particular area of a computer screen (.see colnnnt 10. lines S 10 ol 
l ogna/y.ini), the method ol rogna/./iiii iilenlilies the article corrcspondiiiy lo thai particular arcii 
and articles related lo the idenlit'icd articles are provideil to the u.ser. Hy sliarp e.mlra.sl. tin- 
present invention's method detects reading (as opi^v^ed to ga/ing or starini-.) vi;i ;i ihieslu.ld ami 

in the instance that resuling i.s detected, ihe present invention extracts the le.\t (see Vecindnin sani 

l'iiK>- 7of U 
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hcicrogcneous conteni" aspccl of claim 1) thai was read and iclilevcs iiddilioiral inloruialion 
(rciricvcd from a tialabasc twcr a uclwork). 

Regarding independent claim 7 and K, applicanis conlciid dial iuuIIukI of I ui:JKi/./.mi iails 
U) provide for an accuralc model ol' users as provided by the claimed invouiicMi. I'lie meilMul ol 
'r<>gna/./iin idenlidcs what applications on a compulcr screen (or areas on a rt>mpuk i si n en) an- 
gelling die user*s alicnlion and any such idenlillcd applications or areas are ilten used u> Ihk- imu- 
additional infonnaiiori (e.g.. adverlisoinonts) providetl. On the (Oilier hand, (he pri-senl 
inveiilion's method lirst <lelecls what inlbnnalion was read hy a user (hase<l upttn a Ihreshold). 

CD 

and upon dctcelion of reading',, llie present invention's method exiraris Hie read (e.xl an«l Ime ^ 

limes accurate models and adveilisemonis based upon die read text that was exiraeled. ^> 

< 

Q 

As to claim «), applicanis refer the j-xaminer to seeiion Do! pa>.>^ 1 1 td (he apphealiou as 
filed. This spccirieully oulbnes the use of the n^elhod oC the present inveniiivn n> piovide U>\ 
accurate help in computer applications, l-'or example, by analyzing read ti.xU a syslem ran 
proviile accurate help based ujion the read text (see conlext-sensilive help oCseciion I ) o^pa.^e I ? 
of die application as llled). Tognay./ini Tails to disclose Ihc accurate help lealme *d Ihe pieseni 
invention. 

The above-menlioned argnmenls lor dependent ehnms 2-1 I equally apply lo tlepeuikni 
claims sets 14-22. Thus, apidieanis respeclfully ask the examiner I*) reconsider tle|K iulejU i hums 
2-1 1 and 14-22 in V\^)^i of the ahovo mentioned arguments. 



o 
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SUMMARY: 

As has been detailed above, ikmic oflUe refereiiees. ci<ed or applied, pitu'idc Inr ihc 
:ipocific claimed dclails of applicanis' picseiUly claimed iiwciUioiK nor renders dutni obvitms. li 
is believed thai diis case is in conililiiin lor allowance and reconsideraiion dieioid and t;:irly 
issuance is respectfully retpiusicd. 

As diis amendment has been timely filed wilhin the sel period ofrcsponsi:, no pchiuHi loi 
extension ol' lime or associaled fee is required. 1 lowcvcr, ibe ( 'oinmissionei is Ik ivby anllioi i/rd 
to charge any deiicicncies in the lees provided to Oeposjl Aeeonm No. ()')Am I . 

iril is (ell. that an inlerview wonkl ex|>edile prosecution ofthis appliealiotK pUmm: d*^ 
hesitate to contact applicants' represcnlalive al the below number. 

Respeclfully subniilied. 

Randy W. Uicasse 
Registration No. 34,:U)8 

1725 Duke Street 
Suite 650 

Alexandria, Virginia 22^14 

(7<)3)S38-7683 
hebruaiy?, '2m^ 
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In llic S pecif! ca lioit; 

/'/f«.v<' (imcml iHt'^r 2, line 20 to /x/.uc .»'. liiw I as follows: 

tlHunlization - inicjjralioii <usiuilly ;ivcniyin«) of a scquciilial of inuisuii inculs wlu rc llu- 

iiK'usurcmcnU; in each yioup ilo mX overlap, Ilic niciisurciucnls may (k: over linn- or .sp;uf. In 
llie tfitHelUey mtJ-t^vei lime. 



Fk'asK amend pufie J, Unci '/ to 22 us follows: 

('ompulcns arc a widely used resource in today's s«K-ie(y. In niosl sy.skuis, a iis^i 
miinipidalcs a keyboard or a mouse lo eonmiiinieale wilh a compiuer. Miukrn sysli-nis im iiido a 
graphical user interlace {(iUI) which comniiinicalcs with llie iisei hy ilisplaynu-. vaiUMis 
heterogenous content. In the conlexl of this paleni applicaiioii. l)e(er«)Keneoit.s l oeiuiil mi liidi s 
objects normally encountered «>n conipulcr monitor.'*. I'or example, as illusliaiiil in I'i);.uri' I. ^ 
heterogeneous content 10» includes (but is noi restricted to) any oi^.or a oHulMnaliun ol: l. xl ^ 
102. images 104, hyperlinks !()(>, windows 10K, icons 110. or menus 112. Wlien users vu:sv c/> 
computer monitor widi heteroi-eneous content di.splayed on its screen, lliey uidi/.i? an mpui 
<levice. such as a mouse or a keyboard, to mauiindate one (or a comhinaiicut .>)) ]iclern}.ynuus ^ 
conlenl items based on their interesis. l-igure 2 illuslr.ilcs a prior arl sysloui which c*.mpnM-s ^ 
numitor 200, compuler CVW unit 202, mouse 2(»4, and keyboard 206. Dseis view .>u die y_ 
computer monitor 200 various heterogeneous content ilcnts (like A. H, antU') .iml. based on iIkii q 
interest, they interact with one or more or a combination of hclerogeiie»>iis jonk ni items via 
mouse 204 or keylward 206. This step is very "user driven" since llie system ihK-.s not have- a 
means for dynamically tiaekinj^ user inleresta (wheUter they are interesleil in A. It. or C) CP 
regarding the displayed heterogenous content and hence the ci>mpulei wails foi iIk usii U) ^ 
re.spond via an input device beloie proceeding with any action. ^ 

rtiuisc amend pu^c 4. liiws /.? (o pa^r iinc 7 as follows: 

Hgurc 3 illtLStralcs sonic of Ihc coniiuun eye niovcnienls obsiirvcd *!ni»nK tviulinir, 
("omnion eye movcmcnl behaviors ohservcd in rcailing 3(M» incliak: lorwiircl s;)t r;ulcs (*>( jiunps) 
302 of various Icnglli (cyc-nmventenls (o ihc right), niicro-sacciules (siniill ninvvnu'uls m viu u^tis 
tJireclions) 3«4, fixiilions of various Unralion 306, rcgiv^isions (eye nuwcnieiils )o ihc WW) 30S, 
jillei-s (shaky inovenienls) 310, anti nyslatjmus (a rapid, invokmiai^. oscillaiory mo\nn\ ol* ihe 
eyeball) 312. As illuslraled by higurc 4, (hose behaviors in Uirn depend kmx scveial lac Uvts MM). 
some of wiiich include (bu( are nol restricted to): lcx( diiUcully 402, wnul lenyjh 404, wtatl 
ircquency 406, Ibul si/.e 408, ("ont color 410, diKiortion 412. user distance lo display 414. and 
individual dilTerenccs 416. Individual dilTerenees lhal alTcet eye luoveinenis CinUjer inchuk-, bui 
are noi limited to, reading speeii 418, inlelligencc 420, ai-e 422, and lani^uarr skills 4>4. l oi 
example, as ihc text becomes more dinicult lo compreheniL I'lXaLiiUi duraiion innca^cs (as 
described by Jusi & ( arpenler u\ tlieir paper cnlilled, A iltcary (^fn miuiy,: /-row r\r Jiui/um.s fn 
(omprehi^nsion .Psychological kevicw. IV81)) and Ihe number of rcL'.ressions iiureascs (as 

i'ayy 10 nf It 
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dcscrihetl by Rayner & hni/ici in ihcir paper cniittcil, /'mshisi li-»,,u.ranh ..nihtitno,,.',- 
cnmnkmeiils. Quarterly .louinul of lixpcrimcnlal Psycliology, 1*>K7.) (liven llic compk-xily ol 
cyc-ya/e pallcms and ihe dclailcd iiironuatioH aboiil llic loxf and llu! mdivulnal ivi|ii.ivd n. 
preclict these pallcms, (here have been lU) atlenipu; lo build a sysicin to iwDgni/.e .va.ln.:. unid 



now. 
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